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The super-Kamiokande collaboration have used multi-ring events to discriminate 
between the — > v T and z/ M — > v s solutions to the atmospheric neutrino anomaly. 
We show that the effect of systematic uncertainties in cross sections are so significant 
that the usefulness of multi-ring data to distinguish between these two solutions is 
doubtful. 
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There are two quite different interpretations of the neutrino physics data. One 
possibility is that the solar and atmospheric neutrino anomalies result from three 
flavour oscillations of the three known neutrinos with two large mixing angles[l]. 
While this scheme provides a very good fit to the solar and atmospheric data, it 
cannot accommodate the LSND data[2]. In fact, this three-flavour interpretation of 
the atmospheric and solar neutrino anomalies is disfavoured at the 4-5 sigma level 
from the LSND neutrino experiment. 

An alternative possibility invokes a fourth effectively sterile neutrino (^ s )[3], 
which allows each neutrino physics anomaly to be explained by 2-flavour oscillations [4] 
[Solar by large angle v e — > v T oscillations, atmospheric by large angle or maximal 
Vfi — >■ v a oscillations and LSND by V e — > oscillations] . In this case the LSND data 
can be explained, however a subset of the super-Kamiokande data disfavour this pos- 
sibility at about the 1.5-3 sigma level (depending on how the data are analysed) [5, 6]. 

Both schemes provide an acceptable global fit of the data 1 , although each scheme 
fails to provide a good fit to some particular data subset. In the case of the 3 neutrino 
scheme the LSND data is not explained, while in the case of the above 4 neutrino 
model a subset of super-Kamiokande data are poorly fitted. 

Given this current situation, it makes sense to a) check the LSND result, which 
is being done by MiniBooNE[8] and b) check the — > v T versus — > v s discrim- 
ination. The — > v T versus — > v s discrimination will eventually be done by 
the long baseline neutrino experiments. In the meantime it makes sense to exam- 
ine the robustness of super-Kamiokande's claim[5] that the — > u s hypothesis is 
disfavoured by a subset of the super-Kamiokande data. 

Super-Kamiokande identified three subsets of data which might potentially dis- 
criminate between the — >■ v T and — >• v s solutions to the atmospheric neutrino 
anomaly [5]. However, this discrimination, was not particularly stringent (super- 
Kamiokande found that the — > u s possibility had a goodness of fit (gof) of about 
0.01), and an alternative analysis[6] of the same data (but using binned data rather 
than ratios) gave a much better fit (a gof of about 0.1). 

One of the issues discussed in Ref.[6] was that of systematic uncertainties. Two 
main sources of systematic uncertainties were identified. In the through going muon 
data set, one can have atmospheric muons masquerading as neutrino induced muons 
in the (near) horizontal bin. It is difficult to reliably estimate such contamination, 
and if it is larger than expected then the resulting neutrino induced through going 
muon zenith angle distribution will be flatter, which improves the fit of the — > v s 
oscillation hypothesis. 

In the multi-ring analysis, uncertainties in the cross sections are expected to 
be significant [6] . The main purpose of this paper is to examine the effect of cross 

1 The global goodness of fit (gof) of the above 4 neutrino scheme was explicitly calculated in 
Ref.[7] to be 0.27, which means that there is a 27% probability of obtaining a worse global fit to 
the data. 
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sectional uncertainties in the up-down multi-ring ratio used by super-Kamiokande. 
As we will show, these uncertainties are quite large - much larger than those quoted 
by super-Kamiokande. In fact, our analysis suggests that multi-ring data, at least 
with the super-Kamiokande cuts, cannot provide a useful discrimination between 
the — * v T and — >■ v s hypothesis. 

Super-Kamiokande employed the following selection criteria for their multi-ring 
analysis: (1) vertex within the fiducial volume and no exiting track; (2) multiple 
Cerenkov rings; (3) particle identification of the brightest ring is e-like; (4) visible 
energy greater than 400 MeV. According to the super-Kamiokande monticarlo[5], 
events satisfying this selection criteria (assuming no oscillations) will be made up 
of Neutral Current (NC), u e Charged Current {u e CC), and Charged Current 
[v^CC) events in proportion: 

NC 29%, v e CC 46%, v^CC 25% [no oscillations] (1) 

For maximal — > v s oscillations with 5m 2 ~3x 10~ 3 eV 2 approximately half of 
the up-going oscillate into v s . This will lead to an overall up-down asymmetry for 
the multi-ring events due to interactions. It is convenient to define the quantities, 
ri,r 2 and R where T\ is the up-down ratio for v^CC events, r 2 is the up-down 
ratio for induced NC events and R is the ratio of v e /(is^ + v e ) events in NC 
(R PS 0.25). With these definitions, the multi-ring up-down ratio (with 'up' defined 
as cos 9 < —0.4, and 'down' with cos 9 > 0.4, i.e. the same definition as used by 
super-Kamiokande) is simply: 

r{v^^v s ) = 0.46 + 0.25 * n + 0.29 *R + 0.29 *(1-R)*r 2 

~ 0.53 + 0.25 *n + 0.22 * r 2 (2) 

If there were perfect angular correlation, we expect r\ = r 2 = 0.5 for maximal 
oscillations. In this extreme case, one expects [from Eq.(2)] r ~ 0.77. But the 
angular correlation is not perfect because of the momentum of the recoiling nucleus is 
not observed. For NC events, one has in addition the momentum from the scattered 
neutrino (and there are also undetected neutrinos from decaying pions and charged 
particles/photons below the Cerenkov threshold). So one would expect something 
like r\ ~ 0.55, r 2 ~ 0.60 to be more realistic, suggesting a riv^ — > v s ) 0.80. 

In the — >• u T case, things are a little different since all of the NC events are 
up-down symmetric and there are additionally up-down asymmetric u T CC events 
(about 3% according to the super-Kamiokande MC[5]). Assuming perfect angular 
correlation, so that the u T CC events are all up-going, the net effect is an up-down 
ratio of: 

r{y^ ->• v T ) = 0.75 + 0.25 * n + 0.06 (3) 

Perfect angular correlation for the v^CC events would imply r 1 = 0.5, giving r(f jU — > 
u T ) w 0.93, Of course, the angular correlation is not perfect, with r x 0.55, but 
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this should be roughly compensated by the v T CC events giving some down going 
events. In summary, we estimate a multi-ring up-down asymmetry for the — > v s 
and z/„ — > u T cases of: 



According to super-Kamiokande, figure lb [5], their MC agrees with the above esti- 
mates (within 1% for 5m 2 ~ 3 x 1(T 3 eV 2 ). 

Note that there is only a small difference between the expected r(f (U — >• z/ s ) and 
— ► ^r) values (about 14%), so the estimation of systematic errors is extremely 
important. Because the multi-ring sample, as defined by super-Kamiokande, in- 
volves a combination of up-down symmetric events and up-down asymmetric events, 
uncertainties in the relative proportion of these events will lead to systematic un- 
certainties in r. The number of events satisfying the super-Kamiokande selection 
criteria, coming from the three main processes, NC, v e CC, CC have signifi- 
cant uncertainties because of uncertainties in the size and shape of the differential 
cross- sect ions involved. 

We now try to estimate these systematic uncertainties in the r ratio due to these 
cross sectional uncertainties. Given the super-K selection criteria, the cross sectional 
rate uncertainties of the NC, u e CC ', v^CC ', u T CC induced multi-ring events should 
be approximately uncorrelated. This is because the underlying processes are quite 
different, as illustrated in Figure 1. 



r(z/, 




~ 0.53 + 0.25 *n + 0.22* r 2 ~ 0.80 
~ 0.75 + 0.25 * n + 0.06 ~ 0.93 



(4) 
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Figure la,b,c,d: Examples of the four types of multi-ring processes. The large 'O' repre- 
sents non-perturbative strong interaction physics. Figure la: v e CC induced events. The 
7r can be a tt° or a charged pion (the charge, depending on whether one has a neutrino 
or anti-neutrino induced event). In this case the the brightest e-like ring can originate 
from the electron or the pion (if the pion is neutral). Figure lb: CC induced event. 
In this case the emitted pion should be neutral, and the e-like event must come from the 
photon(s) of the decaying neutral pion. In this case the pion must therefore be produced 
with an energy greater than the muon to satisfy the super-Kamiokande selection criteria 
(this makes this process quite different from the process Fig. la). Figure lc: NC events. 
In this case, one expects two (or more) ir production to account for most of the events. 
A single 7r° could lead to two e-like rings, however a tt° produced at high momentum the 
rings merge cannot be distinguished. Figure Id: u T CC events. The decay of the tauon 
can lead to a multi-ring event. 

Note that the v e CC and v^CC events appear very similar. Yet, the cross section 
uncertainties are largely uncorrelated even in this case. This is because of the super- 
Kamiokande selection criteria for multi-ring events which demands that the brightest 
ring is e-like. This selection criteria strongly enhances the u e CC process over the 
v^CC process, since in the former case, the brightest e-like ring typically comes from 
the emitted electron while in the latter case it must come from the emitted pion. 
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Thus, in the v e CC process, the lepton is (typically) emitted with more energy than 
the pion, while in the v^CC process, the lepton is emitted with less energy than the 
pion. Therefore, the cross sections for v e CC and v^CC events are not correlated. 2 
Define N UeC c, N NC , N v cc, ^v T cc to be the number of v e CC events, NC events, 
VyCC events and v T CC events all satisfying the super-Kamiokande selection criteria 
and assuming no oscillations. In this case, Eqs.(2,3), can be equivalently expressed 
as: 

/ x N v&cc + N v C c * ?"i + R * n nc + (1 - R) * N NC * r 2 
r\v a — > v s ) = 

1 ^ ' N VeC c + N NC + N^cc 

, v N UeCC + N NC + N u ^ C c * n + 2N UtCC 

r \v a — > v T ) = 5 

1 ' N VeCC + N NC + N^cc 1 ' 

The effect on the multi-ring up-down r of uncorrelated cross section uncertainties in 
the v e CC ', Vfj.CC, NC and u T CC processes can now be easily evaluated. We denote 
the percentage uncorrelated uncertainties in Nnc, N Ue cc, ^v^cc-, N Ut cc by: 

$NCi $v e CC, Sis^CC, &u T CC (6) 

That is, the number of v e CC events is N Ue cc(l ± $v e cc)i etc. We now estimate 
the corresponding uncertainty in the Super-Kamiokande multi-ring up-down ratio, 
r. Let us take the v e induced CC events as an example. If the number of v e induced 
CC events is uncertain by an amount 5 Ve ccN Ve cc then the corresponding uncertainty 
in r is 

dr 

oN VeC c 
dr 

Su e ccN VeC c- (7) 



dN UeCC 

In the case of the — > v a hypothesis, from Eq.(5), we have 
dr 

N -eCC-^ = [1 - -»• u a )] N Ve cc/(N VeC c + N NC + N^ C c) 



VeCC 



0.46*[l-r (z/ M ^z/ s )] (8) 



where ^(z/^ — > u s ) is the estimate of the 'central' value of r. Putting r (z/ M — > u s ) ps 
0.80 leads to an uncertainty in r of 0.095 Ue cc, implying a percentage uncertainty 

2 In fact, the integrated cross section for producing a v e CC events is about 5 times larger than 
for a Vfj.CC event. This can be seen from a) Eq.(l), where the number of v e CC events is nearly 
double that of the u^CC events (46% c.f. 25%) and b) the flux of v e is only about 1/3 that of v^. 
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in r of Sr/r 0.1lS Ve cc- A similar procedure for the other processes, gives the 
following uncertainty in r: 



riy^vs) = r (l±0MS NC ±0.llS Ue cc±0.08S^cc) 

r(i/„-n/ r ) = r (l ± 0.02^ c ± 0.03^00 ± O.lO^cc ± 0.06^00) (9) 



Now, the precise values for the Si needs careful consideration. The multi-pion pro- 
duction cross sections at energies of ~ GeV are quite poorly measured with uncer- 
tainties in the range 30 — 40% [9]. We will assume a 35% uncorrelated uncertainty in 
N Ue cc, N u ^cc an d N NC - This implies a total uncertainty in r (adding the various 
uncertainties in quadrature) of about: 3 



Thus, we estimate that the theoretical expectation for the super-Kamiokande r 
ratio for their multi-ring events has systematic uncertainties of about 5% (in the 
v n v s case). The super-Kamiokande claim[5] that the uncertainty in r due to the 
cross section uncertainties is less than 1% is very hard to understand. Indeed to 
get a 1% uncertainty in r would require cross sectional uncertainties 5 times smaller 
than their expected value. In other words, the uncertainties in the NC, CC rates 
would have to be less than about 6%, which does not seem possible. At the very 
least, such low uncertainties would have to be carefully and explicitly justified. 

So far, we have tried to estimate the systematic uncertainties in r due to cross- 
sectional uncertainties. It would also be useful to try and independently estimate 
the central values, Eq.(l). Indeed, the proportion of NC events found by super- 
Kamiokande seems somewhat larger than might be expected. If there were only one 
pion produced, then the process in figure lb might be expected to be roughly the 
same magnitude as the process in figure lc. But, this is not the case. The problem 
is that the pion needs to be quite relativistic (E > 400 MeV) for its direction to be 
correlated enough with the incident neutrino to have significant up-down asymmetry. 
Yet, in that case, the two e-like rings tend to merge. If they didn't one could simply 
select events with 2 e-like rings with invariant mass of (and with visible energy 
greater than 400 MeV) to to obtain an almost pure NC sample. Such a sample 
would have a up-down asymmetry of r 2 ~ 0.6 for — >■ v s and 1 for — > v T and no 
annoying cross-section uncertainties to worry about! This would allow for a sensitive 
discrimination between — >• u T and — > u s modes [10]. Unfortunately this is not 
possible because a n° with high momentum produces two photons in nearly the 
same direction and the two rings merge into one [11]. Hence to obtain 2 rings, one 

3 Of course, systematic uncertainties are not Gausian etc... so the usual cautionary remarks are 
in order. 



riy^ -»• v a ) 



r (^^ s )(l±0.05) 
r (iv-n/ T )(l±0.04) 



(10) 
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needs multi-pion production for the NC process. One might therefore expect that 
the number of NC events to be significantly less than the number of v^CC events. 

In conclusion, we have critically examined the effect of systematic cross section 
uncertainties in super-Kamiokande's multi-ring analysis. Our study indicates that 
the systematic error is significant - approximately 5% in the up-down ratio. This 
is important because the difference between the — > v s and — > v T hypothesis is 
only 14%. Unfortunately, it seems that the use of multi-ring data to convincingly 
discriminate between the — >• v T and — > v s hypothesises is doubtful. 
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